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Background : Big Data Era 


1960 1980 1990 2000 2010 


+44/B 


Mobile 
Internet 


„| M Desktop 
SEX x je) 


Data generated 


Internet | 
| per year by 2020 


x urce: EMC Digital Universe Study” with data and 
nalysi ; by IDC April 2014 


Im 10w100w 1B 108 50e 
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Computing drives devices into higher power consumption 


GPU Vs CPU TDP Trend 
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THERMAL DESIGN POWER (TDP) IN WATTS 
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© 2, Today’ s Datacenter Challenges 


©2018 Alibaba Group 


Today s Datacenter Challenges nes OP O) Hirn 


1. high power density racks' cooling 


Rack with 42*1U Server power trend 
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In-Row Cooling 
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Datacom Equipment Power Trends and Cooling Applications --ASHRAE 


> Computing drives devices into higher power consumption. Rack power density is growing 
rapidly 
> Air-Cooling cannot meet the heat dissipation demand any more 
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2. PUE/TCO 


Total data center power ( kw ) 


Data center Power usage effectiveness(PUE)= 
Total IT Power | kw 


Average PUE of your largest data center: 
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survey of over 1100 data centers 


> The energy consumption of the data center for cooling is quite large. 


> How to achieve low PUE and optimized TCO? That has become a new challenge. 
©2018 Alibaba Group 


(C 2 Alibaba Group 基础 架构 事业 群 
s 阿里 巴巴 集 四 


Key Points 


o 3, Why immersion cooling? 


©2018 Alibaba Group 


EC fib ZR Fa) SS UI BF 


Alibaba Infrastructure Service 


baba Group 


ELS 
s DEPP € [71] 


What is immersion cooling? 


Immersion Cooling 
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» Liquid (3M Fluids) has better Specific Heat 


Cooling-tower 


Water Loop P 


Capacity than air. 
> No CRAC in IDC, low PUE 1.05-1.07 
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CDU 
Heat exchanger 


Inert Fluid con) { 


Pumps 
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Why immersion cooling? 


Air Cooling Cold Plate Immersion Cooling 


0 means “Base Line” 
+ means “Better” 
- means “Worse” 


Immersion Cooling is the best. 


Cooling Capacity 


Hardware Integration No fans in immersion Cooling. 


Maintenance New mechanical design. 


Hardware Reliability Unaffected by dust, humidity and vibration. 


Hardware Performance Cooling helps improving performance. 


No fans, chillers, CRAHs. 


Energy Efficiency 


Heat Recovery Easy to be recovered from liquid. 


Noise No fans, no noise. 


Corrosion 0 Isolation from air, no corrosion. 
| oa 00 0| #8 00 No fans, chillers, CRAHs. Low PUE. 


Advantages of immersion cooling: (1) Best cooling capacity (2) lowest TCO/PUE .... 
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Cooling Approaches: Efficiency Vs Density 


System: Immersion 


Cold Plate 


Supported Density (kW/Rack) 


Rack: RDHx 
Row: In Row 


Room: CRAC/CRAH 


1.5 


©2018 Alibaba Group 


(C 2 Alibaba Group 基础 架构 事业 群 
Do) EB ED EP =F 


Why immersion cooling? 


Less Power Consumption 


Power consumption comparison 


Air-cooling Vs immersion cooling 
PUE=1.5 — Less Carbon emission 
om Total:0.963 Better TCO 


> 36% less power by using immersion cooling 


IT Equipment 
(KW) 


> Reduce 3 tons carbon dioxide emission per IT 


met KW per year 
y= ther 
Air Immersion > TCO optimization 
Cooling Cooling 
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Why immersion cooling? 


Major Causes of Electronic Failures 


Dust 
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Source: US Air Force Avionics Integrity Program 
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Higher Reliability 


Tank 


Liquid protects IT devices from harsh 
environment including high temperature, 
humidity, vibration, dust 
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© 4, Challenges of immersion cooling 
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System level 
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Challenges of immersion cooling 


Basic Level 


Signal Integrity Heat Dissipation 
(PCB/ CONN) Surface Treatment 


Material Compatibility 
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Challenges of immersion cooling 


Component Level 


P A Optical Devices 


Performance, Stability, 
Energy efficiency 
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Challenges of immersion cooling 
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oystem Level 


Top cover made in aluminum 

with 8mm enhanced glass 
Gas lifter at two sides 
to help users to open 
top cover 


Latch embedded at top 
cover for unlock function 


3mm Stainless body Inner heat condenser 


Sheet metal box 
welded inside the 
tanker to save 3M FC- 
72 usage Tanker dimension: 
* Width: 1130mm 
Front side 


* Height: 1273mm " 


Server architecture, 
Tank sealing, Data center architecture Monitoring and 


Maintainability, CDU pipe layout Management system 
Space utilization 
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Phase 2 


High power density co- 
design 
and mass deployment 
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1. Immersion cooling is a better way to tackle the high power density 
challenges 


2. Immersion cooling is not far away, but still needs ecosystem partners 
to support 


3. Alibaba is the first CSP to deploy the immersion cooling systems, 
willing to contribute to the community 
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